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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an electronic 
camera such as a digital still camera that captures an 
15 image of a subject and records the captured image as 
electronic image data. 

2 . Description of the Related Art 

Digital cameras in the known art include those 
provided with an image -capturing device such as a CCD 

20 that captures an image of a subject image passed through 
the taking lens and outputs image data and an image 
processing circuit that performs image processing such 
as white balance adjustment and gamma control by 
adjusting the amplification gain to be used on the image 

25 data output by the image -capturing device. At the image 
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processing circuit, image processing is performed by 
calculating parameters such as R gain and B gain for 
white balance adjustment or a gradation curve for gamma 
control in conformance with a predetermined algorithm 
5 based upon the image data output by the image -capturing 
device . 

In such a digital camera in the prior art, color 
information corresponding to the main subject, the 
background and the like, the image of which has been 

10 captured, is averaged to calculate a white balance 

adjustment ^4e# f - i o j r c rrt that will achieve an achromatic 
color. Then, white balance adjustment is performed on 
the image data using the adjustment^eeef JTiuieTTt thus 
calculated. When photographing a person using this 

15 camera, the following problems may occur depending upon 
the composition. 

(1) The white balance adjustment value is calculated 
mainly using color information corresponding to the 
areas other than the skin-colored portion when the ratio 
20 of the area occupied by the skin-colored portion such as 
a face in the photographic field is small. Therefore, 
white balance adjustment implemented by using the white 
balance adjustment ~eee#f-±-e-rerrt thus calculated on the 

A 

skin-colored portion tends to be defective, and 
25 defective adjustment may result in a faded image or a 
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tinted image. 

(2) When a person is photographed in closeup, as in 
portrait photographing, an achromatic color is often not 
achieved by averaging the color information if there are 
5 many highly saturated colors such as flowers and 

greenery in the background. As a result, the white 
balance adjustment calculated under those circumstances 

^ tends to be defective, which may change the hue of the 

% skin color of the person. 

Jf SUMMARY OF THE INVENTION 

An object of the present invention is to provide an 
f! electronic camera that is capable of minimizing the 

^ occurrence of the fading / tinting phenomenon in a 

; 15 satisfactory manner by implementing white balance 

adjustment based upon the results of analysis of the 
photographic scene . 

In order to achieve the object described above, an 
electronic camera according to the present invention 
20 comprises an image-capturing device for photographing 
that captures an image of a subject image passing 
through a taking lens and outputs image data, an image- 
capturing device for scene analysis that is provided at 
a position that is conjugate with the image -capturing 
25 device for photographing relative to the taking lens and 
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receives light from the subject image to output scene 
analysis image data, a gain calculation unit that 
calculates gain by using at least either image data 
corresponding to a large area of the image -capturing 
5 device for scene analysis or image data corresponding to 
a small area at the image -capturing device for scene 
analysis and a gain adjustment unit that performs gain 
adjustment by applying the gain calculated at the gain 
calculation unit to the image data output by the image- 

10 capturing device for photographing. 

The large area refers to a plurality of first areas 
obtained by dividing the image -capturing area of the 
image -capturing device for scene analysis into a unit 
area including a first specific number of pixels. The 

15 small area is constituted of a plurality of second areas 
achieved by dividing the image -capturing area of the 
image -capturing device for scene analysis into a unit 
area including a second specific number of pixels which 
is smaller than the first specific number. It is 

20 desirable that the gain calculation unit calculates gain 
by selecting image data of either the large area or the 
small area in correspondence to the type of subject and 
using the image data in the selected area. 

The electronic camera may be further provided with 

25 a decision-making unit that makes a decision as to 
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whether or not there is an area having image data that 
are judged to indicate an achromatic color among the 
plurality of first areas and further makes a decision as 
to whether or not there is an area having image data 
5 judged to indicate skin color among the plurality of 
second areas if it is decided that there is no area 
among the first areas with image data judged to indicate 
an achromatic color. In this case, if the decision- 
making unit decides that there is an area having image 

10 data that are judged to indicate an achromatic color, 

the gain calculation unit calculates gain based upon the 
image data in the area having the image data indicating 
an achromatic color. If the decision-making unit 
decides that there is an area having image data that are 

15 judged to indicate skin color, the gain calculation unit 
calculates gain based upon the image data in the area 
having the image data judged to indicate skin color. 

In order to achieve the object described above, 
another electronic camera according to the present 

20 invention comprises the image -capturing device for 

photographing and the image-capturing device for scene 
analysis described above, a detection unit that detects 
an area having image data that are judged to indicate a 
, predetermined color in the image data corresponding to a 

25 predetermined area of the image -capturing device for 



5 




scene analysis, a gain calculation unit that calculates 
gain based upon the color indicated by the image data in 
the area detected by the detection unit and a gain 
adjustment unit that performs gain adjustment by 
5 applying the gain calculated by the gain calculation 

unit to image data output by the image- capturing device 
for photographing. 

The detection unit detects; (1) the presence of an 
area having image data that are judged to indicate an 

10 achromatic color among a plurality of first areas 

achieved by dividing the image -capturing area of the 
image -capturing device for scene analysis into a unit 
area including a first specific number of pixels and (2) 
the presence of an area having image data that are 

15 judged to indicate skin color among a plurality of 

second areas achieved by dividing the image -capturing 
area of the image -capturing device for scene analysis 
into a unit areas including a second specific number of 
pixels which is smaller than the first specific number. 

20 It is desirable that the detection unit performs 

detection for an area having image data that are judged 
to indicate skin color if it cannot detect an area 
having image data that are judged to indicate an 
achromatic color. 

25 The electronic camera may further comprises a 
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selection unit that selects either a first photographing 
mode suited to white balance adjustment performed by 
using an achromatic color or a second photographing mode 
suited to white balance adjustment performed by using 
5 skin color. In this case, the color to be detected by 
the detection unit is selected in correspondence to the 
photographing mode selected by the selection unit and a 
gain is calculated by using image data indicating the 

O 

= selected color. 

D 10 In an electronic camera provided with a selection 

- - f- 

%S unit that selects a landscape photographing mode, if the 

Nl landscape photographing mode has been selected by the 

p selection unit, the detection unit may detect, at least, 

M= an area having image data that are judged to indicate an 

□ 15 achromatic color and the gain calculation unit may 

calculate gain based upon the image data in the area 
having the image data judged to indicate an achromatic 
color. In an electronic camera provided with a 
selection unit that selects a portrait photographing 
20 mode, if the portrait photographing mode has been 

selected by the selection unit, the detection unit may 
detect, at least, an area having image data that are 
judged to indicate skin color and the gain calculation 
unit may calculate gain based upon the image data in the 
25 area having the image data judged to indicate skin color. 
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In order to achieve the object described above, yet 
another electronic camera according to the present 
invention comprises the image -capturing device for 
photographing and the image -capturing device for scene 
5 analysis described earlier, a conversion unit that 
converts image data in a predetermined area of the 
image -capturing device for scene analysis to color data 
in either a first color- related coordinate system or a 
second color-related coordinate system, a gain 

10 calculation unit that calculates gain based upon the 
color data resulting from the conversion performed by 
the conversion unit and a gain adjustment unit that 
performs gain adjustment by applying the gain calculated 
at the gain calculation unit to the image data output by 

15 the image-capturing device for photographing. 

The conversion unit converts; (1) image data in a 
plurality of first areas achieved by dividing the image- 
capturing area of the image-capturing device for scene 
analysis into a unit area including a first specific 

20 number of pixels to color data in the first coordinate 

system and (2) image data in a plurality of second areas 
achieved by dividing the image -capturing area of the 
image -capturing device for scene analysis into a unit 
area including a second specific number of pixels that 

25 is smaller than the first specific number to color data 
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in the second coordinate system. 

The electronic camera may further comprise with a 
selection unit that selects either a first photographing 
mode suited to white balance adjustment performed by 
5 using an achromatic color or a second photographing mode 
suited to white balance adjustment performed by using 
skin color. In this case, the conversion unit converts 
image data in a predetermined area of the image - 
capturing device for scene analysis to color data in the 

10 first coordinate system or the second coordinate system 
in correspondence to the photographing mode selected by 
the selection unit. 

In an electronic camera provided with a selection 
unit that selects a landscape photographing mode, if the 

15 landscape photographing mode has been selected by the 
selection unit, the conversion unit converts the image 
data in the predetermined area of the image-capturing 
device for scene analysis to color data in the first 
coordinate system. In an electronic camera provided 

20 with a selection unit that selects a portrait 

photographing mode, if the portrait photographing mode 
has been selected by the selection unit, the conversion 
unit converts the image data in the predetermined area 
of the image-capturing device for scene analysis to 

25 color data in the second coordinate system. 
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Furthermore, in order to achieve the object 
described above, an electronic camera according to the 
present invention comprises the image -capturing device 
for photographing and the image-capturing device for 
5 scene analysis described above, a conversion unit that 
converts image data in a plurality of first areas 
achieved by dividing the image -capturing area of the 
_ image -capturing device for scene analysis into a unit 

area including a first specific number of pixels to 

D 10 color data in a first color-related coordinate system or 

yj 

£? converts image data in a plurality of second areas 

SI achieved by dividing the image -capturing area of the 

O image-capturing device for scene analysis into a unit 

M area including a second specific number of pixels that 

D 15 is smaller than the first specific number to color data 

in a second color-related coordinate system, a gain 
calculation unit that calculates gain using the color 
data in the first coordinate system or the second 
coordinate system resulting from the conversion 
20 performed by the conversion unit and a gain adjustment 
unit that performs gain adjustment by applying the gain 
calculated by the gain calculation unit to the image 
data output by the image -capturing device for 
photographing . 

25 The electronic camera may further comprise with a 
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selection unit that selects either a first photographing 
mode suited to white balance adjustment performed by 
using an achromatic color or a second photographing mode 
suited to white balance adjustment performed by using 
5 skin color. In this case, the conversion unit converts 
scene-analysis image data to color data in the first 
coordinate or the second coordinate system in 
correspondence to the photographing mode selected by the 
selection unit. 

10 In an electronic camera provided with a selection 

unit that selects a landscape photographing mode, if the 
landscape photographing mode has been selected by the 
selection unit, the conversion unit converts scene- 
analysis image data to color data in the first 

15 coordinate system. In an electronic camera provided 
with a selection unit that selects a portrait 
photographing mode, if the portrait photographing mode 
has been selected by the selection unit, the conversion 
unit converts scene-analysis image data to color data in 

2 0 the second coordinate system. 

Another object of the present invention is to 
provide an electronic camera capable of performing white 
balance adjustment by detecting the skin color of the 
main subject from a predetermined image area such as a 

25 focal point detection area to maintain a natural hue 
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skin color of the person. 

In order to achieve the object described above, an 
electronic camera according to the present invention 
comprises an image -capturing device that captures an 
5 image of a subject image passing through a taking lens 
and outputs image data, a color temperature detection 
unit that is provided at a position conjugate with the 
image -capturing device relative to the taking lens and 
receives light of the subject image to detect color 

10 temperature information, a gain calculation unit that 
detects skin color based on the color temperature 
information detected by the color temperature detection 
unit for a predetermined area in the photographic field 
and calculates gain using the skin color and a gain 

15 adjustment unit that performs gain adjustment by 

applying the gain calculated at the gain calculation 
unit to the image data output by the image -capturing 
device . 

This electronic camera may be provided with a focal 
20 point detection unit that detects the focal adjustment 
state of the taking lens in a plurality of areas within 
the photographic field, a focal point detection area 
selection unit that selects a detection area in which 
detection is performed by the focal point detection unit 
25 among a plurality of areas and a lens drive unit that 
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drives the taking lens to the focus position based upon 
the focal adjustment state detected by the focal point 
detection unit. In addition, in this electronic camera, 
the gain calculation unit may detect skin color based on 
5 the color temperature information detected by the color 
temperature detection unit for the detection area 
selected by the focal point detection area selection 
unit to calculate gain using the skin color. The gain 
calculation unit may also calculate gain using the skin 

10 color that has been detected at a point in time at which 
the lens drive unit has completed the focal adjustment 
drive and the gain adjustment unit may perform gain 
adjustment by applying this gain to the image data 
output by the image -capturing device. 

15 In addition, in an electronic camera provided with 

a photometering unit that detects the brightness level 
of the subject image in a plurality of areas in the 
photographic field and a photometering area selection 
unit that selects a photometering area where a 

20 photometering operation is to be performed by the 

photometering unit among the plurality of areas, the 
gain calculation unit may detect skin color based on 
color temperature detected by the color temperature 
information detection unit for the photometering area 

25 selected by the photometering area selection unit to 
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calculate the gain using the skin color. It is 
desirable that the gain calculation unit calculates gain 
based upon a predetermined color if skin color cannot be 
detected . 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 illustrates the structure adopted in a first 
embodiment of a single lens reflex digital still camera; 
FIG. 2 is a block diagram illustrating the signal 
10 processing system in the single lens reflex digital 
still camera in the first embodiment; 

FIG. 3 is a block diagram illustrating the circuit 
engaged in line processing in the signal processing 
system in FIG. 2; 
15 FIG. 4 illustrates the arrangement of pixels 

adopted at the image-capturing device for scene 
analysis ; 

FIG. 5 illustrates the arrangement of color filters 
and the division into middle-sized areas on the image- 
20 capturing device in FIG. 4; 

FIG. 6 illustrates the division into small areas 
implemented on the image -capturing device in FIG. 4; 

FIG. 7 is a graph illustrating the relationship 
between the color temperature and the white balance 
25 adjustment gain; 
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FIG. 8 presents color temperature curves on the 
R/G— B/G coordinates ; 

FIG. 9 illustrates the group decision-making; 

FIG. 10 is a flowchart of the white balance 
5 detection processing ; 

FIG. 11 is a flowchart of the program that is 
activated through the halfway press switch; 

FIG. 12 illustrates the structure adopted in a 
second embodiment of a single lens reflex digital still 
10 camera; 

FIG. 13 is a block diagram illustrating the signal 
processing system in the single lens reflex digital 
still camera in the second embodiment; 

FIG. 14 illustrates the arrangement of filters at 
15 the color sensor; 

FIG. 15 presents color temperature curves on the 
R/G— B/G coordinates; 

FIG. 16 illustrates the focal point detection 
device ; 

20 FIG. 17 illustrates the area selection switch; 

FIG. 18 shows the screen observed through the 
eyepiece lens; 

FIG. 19 is a flowchart of the white balance 
detection processing; and 
25 FIG. 20 is a flowchart of the photographing 
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processing . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
The following is an explanation of preferred 
5 embodiments of the present invention, given in reference 
to the drawings . 

— First Embodiment — 

As illustrated in FIG. 1, the single lens reflex 
digital still camera in this embodiment comprises a 

10 camera main body 70, a finder device 80 that is 

detachably mounted at the camera main body 7 0 and an 
interchangeable zoom lens 90 that is internally provided 
with a lens 91 and an aperture 92 and is detachably 
mounted at the camera main body 70. Subject light that 

15 enters the camera main body 7 0 through the 

interchangeable zoom lens 90 is guided to the finder 
device 80 by a quick- return mirror 71 located at the 
position indicated by the dotted line in a pre-release 
state to form an image at a finder mat 81 and also form 

20 an image at a focal point detection device 36. The 

subject light that forms an image at the finder mat 81 
is further guided to an eyepiece lens 83 by a pentaprism 
82. In addition, in a pre-release state, the subject 
light travels through a prism 84 and an image-forming 

25 lens 85 and enters an image -capturing device for scene 
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analysis 86 to form an image of the subject. After a 
shutter release, the quick-return mirror 71 rotates to 
the position indicated by the solid line and the subject 
light forms an image on an image -capturing device for 
5 photographing 73 via a shutter 72. The image -capturing 
device for scene analysis 86 is provided at a position 
which is conjugate with the image -capturing device for 
photographing 73 relative to the taking lens 91. 

FIG. 2 is a block diagram of the circuit adopted in 

10 an embodiment of the digital camera according to the 
present invention. A halfway press signal and a full 
press signal respectively output from a halfway press 
switch 22 and a full press switch 23 that interlock with 
a shutter release button are input to a CPU 21. When 

15 the halfway press switch 22 is operated and a halfway 

press signal is input, the focal point detection device 
36 detects the focal adjustment state of the 
interchangeable zoom lens 9 0 in response to a command 
issued by the CPU 21, and a lens drive device 37 drives 

20 the taking lens 91 to the focus position so that the 

subject light entering the interchangeable zoom lens 90 
forms an image on the image -capturing device for 
photographing 73, i.e., an image -capturing device 26 in 
FIG. 2. Lens information such as the aperture value of 

25 the interchangeable zoom lens 9 0 is input to the CPU 21 
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via a lens information input unit 38. The CPU 21 
implements drive control on the image -capturing device 
26 via a timing generator 24 and a driver 25. The 
image-capturing device 26 may be constituted of, for 
5 instance, a CCD and hereafter, the explanation is given 
on the assumption that the image-capturing device is a 
CCD. The timing generator 24 controls the operating 
timing of an analog signal processing circuit 27 and an 
A/D conversion circuit 28. 

10 In succession to the ON operation of the halfway- 

press switch 22, the full press switch 23 is turned ON 
to swing the quick-return mirror 71 upward and, as a 
result, the subject light from the interchangeable zoom 
lens 90 forms an image on the light-receiving surface of 

15 the CCD 26 to store the signal charges corresponding to 
the brightness of the subject image at the CCD 26. The 
signal charges stored at the CCD 2 6 are cleared by the 
driver 25 and are input to the analog signal processing 
circuit 27 which includes an AGC circuit and a CDS 

20 circuit. After analog processing such as gain control 
and noise removal is performed on the analog image 
signal at the analog signal processing circuit 27, the 
image signal is converted to a digital signal at the A/D 
conversion circuit 28. The signal thus digitized is 

25 inputted to an image processing circuit 2 9 which may be 
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constituted as, for instance, an ASIC, where image pre- 
treatments such as white balance adjustment, profile 
compensation and gamma control, which are to be detailed 
later, are implemented. 
5 The image data having undergone the image pre- 

treatments further undergo interpolation processing and 
format processing for JPEG compression (image post- 
treatment) , and the image data having undergone the 
format processing are temporarily stored in a buffer 

10 memory 3 0 . 

A display image preparation circuit 31 processes 
the image data stored in the buffer memory 3 0 to produce 
display image data which are then displayed at an 
external monitor 32 such as an LCD as the photographing 

15 results. In addition, the image data stored in the 
buffer memory 3 0 undergo data compression at a 
compression circuit 33 at a certain rate through the 
JPEG format, and are recorded in a recording medium 
(memory card) 34 such as a flash memory via an interface 

2 0 (not shown) . 

FIG. 3 illustrates a line processing circuit 100 
that performs signal processing on the image data from 
the CCD 26 in units of individual lines. This line 
processing circuit 100 is provided at the image 

25 processing circuit 29 to perform image pre- treatment . 
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The line processing circuit 100 performs various types 
of signal processing which are to be detailed later on 
12 -bit R, G and B signals output by the A/D conversion 
circuit 28, and is provided with a digital clamp circuit 
5 101, a gain setting circuit 102, a gain adjustment 
circuit 103, a black level circuit 104 and a gamma 
control circuit 105. 

After the data from any pixel with a defect (its 
address is identified in advance and set in the 

10 register) are corrected, in units of individual lines of 
the output from the CCD 26 and in point sequence, the 
12 -bit R, G and B signals output by the A/D conversion 
circuit 28 are input to the digital clamp circuit 101. 
The digital clamp circuit 101 subtracts the weighted 

15 average of a plurality of sets of pixel data used as 

optical black from the individual sets of pixel data in 
each line in the output from the CCD 26 in point 
sequence and in units of single lines. 

The gain setting circuit 102 sets adjustment gains 

20 for pixel data in R, G and B colors. The adjustment 
gains are set by ensuring that gains provided for the 
pixel data in the individual colors output by the CCD 2 6 
will allow the output levels corresponding to the 
individual colors to achieve predetermined levels. Even 

25 when the output levels of the pixel data output by the 
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different CCDs 2 6 vary due to inconsistency among the 
individual CCD units 26, by setting the adjustment gains, 
the image data levels input to the gain adjustment 
circuit 103 are corrected to achieve the predetermined 
5 levels regardless of inconsistency among individual CCD 
units 26. The gain adjustment circuit 103 performs 
white balance adjustment on pixel data in R and B colors 
^ that have been input by reading out white balance 

)y adjustment R gains and B gains calculated by a scene 

H 10 detection processing circuit 35, which is to be detailed 

^ later, and stored in the memory inside the CPU 21 and 

applying the adjustment gains thus read out to the R and 
D B signals. 

The black level circuit 104 adds a predetermined 
□ 15 value stored in the register of the CPU 21 to the R, G 

and B signals in the output from the CCD 26 in point 
sequence and in units of individual lines. The gamma 
control circuit 105 performs gamma control on the output 
from the CCD 26 by using a gradation look-up table in 
20 point sequence and in units of individual lines. 
— White Balance Detection — 

The white balance detection processing performed by 
the scene detection processing circuit 35 in FIG. 2 is 
now explained in detail. The scene detecting processing 
25 circuit 35 comprises an image -capturing device for scene 
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analysis 86, an A/D conversion circuit 35B that converts 
an analog signal from the image-capturing device for 
scene analysis 86 to a digital signal and a CPU 35C that 
A- generates a white balance adjustment eSe*#drc*irenrt based 

5 upon the digitized signal. The CPU 35C determines a 
white balance adjustment gain by analyzing the 
photographed scene and detecting the white balance for 
it based upon the digital data resulting from image- 
ry capturing performed by the image -capturing device for 
D 10 scene analysis 86. The scene analysis in this context 
yB refers to, for instance, an analysis of the distribution 
SI state of R, G and B signals in a photographed scene. 
Q The image-capturing device for scene analysis 86 
M= may be constituted of a single two-dimensional CCD 
O 15 having 480 pixels arrayed in 24 columns (across) X 20 

rows (down) as illustrated in FIG. 4. At the surface of 
the image -capturing device for scene analysis; 86, an RGB 
color filter 861 divided into 480 blocks constituted of 
24 columns (across) X 2 0 rows (down) in correspondence 
20 to the 480 pixels is provided as illustrated in FIG. 5. 
The RGB filter constituted of the 480 blocks is grouped 
into 16 middle-sized area blocks Mil, M12, ... M43 and M44 , 
each having 6 columns (across) X 5 rows (down) of filter 
elements to be utilized for a first scene analysis, as 
25 shown in FIG. 5. In addition, the RGB filter 
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constituted of the 480 blocks is grouped into forty 
small area blocks Sll, S12, ... S57 and S58 each having 3 
columns (across) X 4 rows (down) of filter elements, to 
be utilized for a second scene analysis, as shown in FIG. 



In the first scene analysis, a detection for color 
without hue, i.e., an achromatic color in the image data 
output by the image -capturing device 8 6 is performed for 
each of the 16 blocks resulting from the division 

10 illustrated in FIG. 5. When the photographic field is 
divided into roughly 16 middle-size area blocks, it is 
highly likely that a plurality of colors belonging to 
the subject are present in a given block. Thus, based 
upon the principle that the value achieved by averaging 

15 the RGB color data corresponding to a plurality of 

different colors present in a given block, indicates an 
achromatic color, a detection for an achromatic color is 
performed by averaging data in R, G and B colors present 
within each block in the first scene analysis. Since 10 

20 sets of data are available in correspondence to each of 
the R, G and B colors in each block Mnm among the 16 
blocks resulting from the division, average values RM(m, 
n) , GM(m, n) and BM(m, n) are calculated for each block 
Mmn through the following formulae (1) through (3) . 
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25 



23 



RM(m,n) = J ^ i (1) 

10 



10 



GM(m,n) = 
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(2) 



2> 



BM(m,n) 



10 



(3) 



5 with m representing an integer in the range of 1 through 
4, and n representing an integer in the range of 1 
through 4 . 

In the formula above, RM(m, n) represents the average 
value among the 10 sets of R data in a given middle-size 
10 area block Mmn, GM(m, n) represents the average value 
among the 10 sets of G data in the middle-size area 
block Mmn and BM(m, n) represents the average value 
among the 10 sets of B data in the middle-size area 
block Mmn. 

15 Using the average values of the R, G and B color 

data calculated for each of the 16 blocks, the data 
corresponding to the three primary colors R, G and B are 
converted to data in the TC— Duv coordinates in 
conformance to JIS Z 8725 "Method of measuring a light 
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source temperature and color temperature • correlated 
color temperature distribution." When the color 
temperatures (TC) corresponding to the 16 sets of data 
converted onto the TC— Duv coordinates are plotted, data 
5 whose value along the Duv axis is within the range of, 
for instance, ± 10 are determined to represent an 
achromatic color and data whose value along the Duv axis 
is outside the ± 10 range are determined to represent a 
chromatic color. If there are any data with a color 

10 temperature value judged to be achromatic among the 16 
sets of data as a result of the first scene analysis, 
the color temperature indicated by the set of data is 
referenced in the relationships between the color 
temperature and the white balance adjustment gains 

15 predetermined as shown in FIG. 7 to ascertain the 

corresponding white balance adjustment R gain for the R 
data and the corresponding white balance adjustment B 
gain for the B data. 

The R gain and B gain values in FIG. 7 are the 

20 values determined in advance through actual measurement 
and expressed as functions of the color temperature so 
as to set the values along the Duv axis of the data 
plotted on the TC— Duv coordinates to 0, i.e., so as to 
set the data judged to be achromatic even closer to the 

25 actual achromatic color. These R gain and B gain values 
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are stored in the storage area of the CPU 35C as a look- 
up table and are read out in correspondence to a 
specific color temperature. 

It is to be noted that if a plurality of sets of 
5 data among the 16 sets of data corresponding to the 

individual blocks are judged to be an achromatic color, 
the average value of the color temperatures of all the 
data judged to be an achromatic color is calculated and 
the color temperature average value thus calculated is 

10 referenced in the relationships between the color 

temperature and the white balance adjustment gains in 
FIG. 7 to ascertain the corresponding R gain and B gain. 
If, on the other hand, no set of data among the 16 sets 
of data corresponding to the individual blocks is judged 

15 to be an achromatic color, white balance adjustment 
^c-^e riicien L a are not set through the first scene 
analysis . 

In the second scene analysis, a detection for a 
specific color, e.g., skin color, in the image data 

20 output by the image -capturing device 86 is performed for 
each of the forty blocks resulting from the division 
shown in FIG. 6. When the photographic field is divided 
into roughly forty small area blocks, it is highly 
likely that only one subject color is present in a given 

25 block. Thus, in the second scene analysis, a specific 
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color present in the individual blocks is detected. 
More specifically, in this embodiment, the color of a 
person's face, i.e., skin color, is detected. Since 
four sets of data are present for each of the R, G and B 
colors in a given block Sij resulting from the division, 
average values RS(i, j), GS ( i , j) and BS ( i , j) of the 
individual color data are calculated for each block Sij 
using the following formulae (4) through (6) 



10 RsM(iJ) = ^ (4) 



GsM(iJ) = ^ (5) 



BsM{iJ) = J ^— (6) 



with i representing an integer within the range of 1 
15 through 5 and j representing an integer within the range 
of 1 through 5 . 

In the formulae above, RS(i, j) represents the average 
value of the four sets of R data belonging in a given 
small area block Sij, GS(i, j) represents the average 
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value of the four sets of G data belonging in the small 
area block Sij and BS(i, j) representing the average 
value of the four sets of B data belonging in the small 
area block Sij . 
5 Using the average values of the R, G and B color 

data calculated for each of the forty blocks, the ratio 
of the R data and the G data and the ratio of the B data 
and the G data are calculated and are converted to data 
in the R/G— B/G coordinates, as shown in FIG. 8. R/G is 

10 calculated as "formula (4) / formula (5)" and B/G is 

calculated as "formula (6) / formula (5)". FIG. 8 shows 
color temperature curves presented in the R/G— B/G 
coordinates. FIG. 8 indicates that the color 
temperature is low in the lower left area where the 

15 color temperature is under 4500K and it rises in the 

upper areas, exceeding 6 50 OK in the uppermost area. An 
area 81 enclosed by the one-point chain line in FIG. 8 
indicates a skin color area to be detected in the second 
scene analysis. It is to be noted that the color 

20 temperature curves in FIG. 8 are stored in the storage 
area of the CPU 35C as a look-up table and a color 
temperature value is read out in correspondence to 
specific ratios R/G and B/G. 

When forty sets of data are plotted on the R/G— B/G 

25 coordinates based upon the ratios R/G and B/G of the 
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average values of the R, G and B color data calculated 
for the forty individual blocks, the data corresponding 
to the area 81 are judged to indicate skin color and 
data outside the area 81 are judged to indicate non-skin 
5 color. If there is any set of data among the forty sets 
of data that is judged to indicate skin color as a 
result of the second scene analysis, group decision- 
making is implemented to decide as to whether or not 
skin color is detected in the area surrounding the area 

10 having been detected to indicate skin color. For 

instance, if skin color is detected in the small area 
S25 in FIG. 6, skin color decision-making is performed 
for a total of eight areas, i.e., areas S14 through S16, 
areas S24 and S26 and areas S34 through S36, as shown in 

15 FIG. 9. If, for instance, skin color is detected in 
three or more areas among the eight areas surrounding 
the area S25, the data of the area S25 are stored as 
skin color data. If, on the other hand, skin color is 
detected in two or fewer areas among the eight 

20 surrounding areas, the data of the area S25 are regarded 
as isolated data and are not stored as skin color data. 

If there are a plurality of areas the data of which 
are stored as skin color data, such as the area S25, the 
average value of the color temperatures individually 

25 determined by using the color temperature curves in FIG. 
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8 for those areas Sij is calculated. The color 
temperature average value thus calculated is referenced 
in the relationships between the color temperature and 
the white balance adjustment gains shown in FIG. 7 to 
ascertain the corresponding white balance adjustment R 
gain for the R data and the corresponding white balance 
adjustment B gain for the B data. If there is only one 
area, such as S25, with its data stored as skin color 
data, the color temperature ascertained for the area is 
directly referred in the relationships shown in FIG. 7 
to determine the corresponding R gain and B gain for 
white balance adjustment. If there is no area with 
image data stored as skin color data among the forty 
blocks, white balance adjustment^^ife±^-e^renrbs are not 
set through the second scene analysis. 



If no white balance adj ustment^eeef f iuienLs are 
determined in the first scene analysis or the second 
scene analysis described above, the color temperature 
value 5500K, which is recorded in the memory in the CPU 
35C as the default value is read out. By referencing 
this value 5500K in the relationships in FIG. 7, default 



white balance adjustment A c^e f -fri-c i c n trs R gain and B gain 
are determined. 

The gain adjustment values R gain and B gain 
determined as described above are temporarily stored in 
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the register at the CPU 21 as white balance adjustment 
values. When white balance adjustment is performed on R 
and B color pixel data input to the gain adjustment 
circuit 103, the gain adjustment circuit 103 reads out 
5 the R gain and B gain stored within the CPU 21 to apply 
them to the R and B signals respectively. 

The white balance detection processing described 
above is now explained in reference to the flowchart in 
FIG. 10. The white balance detection processing is 

10 repeatedly performed over specific intervals while the 
power of the digital still camera remains ON. In step 
Sll, the signal charges are stored at the image- 
capturing device for scene analysis 86, the stored 
charges are cleared and converted to digital data at the 

15 A/D conversion circuit 35B and then are taken into the 
CPU 35C. In step S12 , the data taken into the CPU 35C 
are divided into 16 middle-size area blocks, and the 
average values of data in R, G and B colors present in 
each of the divided blocks are calculated. In step S13, 

20 the 16 sets of RGB data are transformed into TC— Duv 
coordinate data and in step S14, detection for 
achromatic color data in the data having undergone the 
coordinate transformation is performed. 

In step S15, a decision is made as to whether or 

25 not any achromatic color data have been detected, and if 
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it is decided that two or more sets of achromatic color 
data have been detected (step S15; Y (two or more)), the 
operation proceeds to step S16 to calculate the average 
value of the color temperatures of the detected 
5 achromatic color data before proceeding to step S17. If 
it is decided in step S15 that there is one set of 
achromatic color data (step S15; Y (one)) the color 
temperature of this set of achromatic color data is 
carried over to step S17 . The operation performed in 

10 steps S12 through S15 described above constitutes the 
first scene analysis processing. 

If, on the other hand, it is decided in step S15 
that no achromatic color data have been detected (step 
S15; N) , the second scene analysis in step S19 and 

15 subsequent steps is implemented. In step S19, the data 
taken into the CPU 35C in step Sll is divided into forty 
small area blocks, and the average values of the data in 
R, G and B colors present in each divided block are 
calculated. In step S20, the forty sets of RGB data are 

20 converted to R/G— B/G coordinate data, and in step S21, 
detection for skin color data in the data having 
undergone the coordinate transformation is performed. 

In step S22, group decision-making processing, in 
which skin color data detected in a small area block are 

25 judged to be true skin color data only when skin color 
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is detected in at least a specific number of small area 
blocks among the eight small area blocks surrounding the 
small area block where skin color is first detected, is 
performed. Based upon the results of the group 
5 decision-making processing, a decision is made in step 
S23 as to whether or not there is any set of skin color 
data that has been judged to be true skin color data, 
and if it is decided that there are two or more sets of 
skin color data (step S23; Y (two or more)), the 

10 operation proceeds to step S24 to calculate the average 
value of the color temperatures ascertained in 
correspondence to the detected skin color data before 
proceeding to step S17. If it is decided in step S23 
that there is one set of skin color data (step S23; Y 

15 (one) ) , the color temperature corresponding to this set 
of skin color data is carried over to step S17. If it 
is decided in step S23 that there is no set of skin 
color data (step S23; N) , the operation proceeds to step 
S25 to read out the color temperature value 5500K which 

20 is stored in the CPU 35C as a default value before 
proceeding to step S17 . 

In step S17, the white balance adjustment R gain 
and B gain are read out from the look-up table stored in 
the storage area of the CPU 35C in correspondence to the 

25 color temperature. When the R gain and B gain values 



33 



thus read out are stored in the CPU 21 in step S18, the 
processing in FIG. 10 ends. 

The operation of the digital still camera 
structured as described above is now explained. FIG. 11 
5 is a flowchart of a program activated through the 

halfway press switch. When the halfway press switch 22 
is operated, a focal point detection operation at the 
photographic zoom lens 90 and a photometering operation 
y£ to detect the brightness of the subject are performed in 

H: 10 step S31. When the focal adjustment state is detected 

y=£ by the focal point detection device 36, the lens drive 

St device 37 drives the taking lens 91 to the focus 

Q position based upon the detected focal adjustment state. 

M; The brightness level of the subject is detected by the 

P 15 CPU 35C by using the data output by the image -capturing 

device for scene analysis 86. When the CPU 35C outputs 
data indicating the detected brightness to the CPU 21, 
the CPU 21 calculates an exposure value based upon the 
brightness data and the aperture value of the zoom lens 
20 90 provided by the lens information input unit 38. 

In step S3 2, the white balance adjustment R gain 
and B gain values stored in the register at the CPU 21 
are read out as explained earlier. If it is decided in 
step S33 that the full press switch 23 has been operated, 
25 the quick return mirror swings upward to start the 
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photographing sequence. In step S34, the individual 
pixels at the CCD 26 store a charge related to light 
received, and when the storage is completed, the stored 
charges at all the pixels are sequentially read out. In 
5 step S3 5, image data that have been read out undergo 
processing at the analog signal processing circuit 27, 
are converted to digital image data at the A/D 
conversion circuit 28 and then are input to the image 
processing circuit 29. Then, the operation proceeds to 

10 step S36, in which the image processing circuit 29 

performs the white balance adjustment explained above, 
gamma gradation control, JPEG formatting processing and 
the like. When the image processing is completed, the 
operation proceeds to step S3 7 in which the image data 

15 having undergone the image processing are temporarily 

stored in the buffer memory 30. In step S38, the image 
data are read from the buffer memory 3 0 and data 
compression is performed at the JPEG compression circuit 
33. In step S39, the compressed image data are stored 

20 in the memory card 34 before ending the processing. 

While the explanation above is given on the 
assumption that photographing is performed under natural 
light, it becomes necessary to adjust the white balance 
adjustment gains if, for instance, photographing is to 

25 be performed under fluorescent light. Generally 
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speaking, the color temperatures of RGB data obtained 
through a photographing operation performed under 
fluorescent light are higher than those obtained through 
a photographing operation performed under natural light. 
5 Such a difference in the color temperature can be 
compensated for by correcting the R gain and B gain 
values in FIG. 7 by a specific quantity. Thus, two 
look-up tables storing R gain and B gain values are 
prepared, one for photographing under natural light and 

10 the other for photographing under fluorescent light, so 
that values can be read out by switching look-up tables 
in correspondence to the photographing light used in the 
current photographing operation. 

The features of this embodiment are summarized 

15 below. 

(1) In the first scene analysis in steps S12 through 
S15, the photographic field is divided into sixteen 
middle-sized areas, the averages of the data in R, G and 
B colors are calculated for each divided area and the 

2 0 RGB data are converted to TC— Duv coordinate data to 

detect achromatic color data. As a result, since it is 
highly likely that a plurality of colors belonging to 
the subject are present within a given middle-size area 
block, an advantage is achieved in that achromatic color 

25 detection is facilitated by averaging the RGB color data 
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within each block. In addition, while the arithmetic 
operation that must be performed when converting the RGB 
data to TC— Duv coordinate data is bound to be lengthy if 
the photographic field is divided into a large number of 
5 areas, the work load on the CPU can be reduced by 

dividing the photographic field into only sixteen areas, 
thereby achieving an advantage of reduced processing 
time . 

(2) Since the average value of the color temperatures 
10 of achromatic color data detected in the first scene 

analysis is calculated and the white balance adjustment 
R gain and B gain are ascertained in correspondence to 
the average value of the color temperatures thus 
calculated, consistent white balance adjustment is 
15 achieved for the entire image plane, thereby making it 
possible to reproduce the subject color. 

(3) In the second scene analysis in steps S19 through 
S23, the photographic field is divided into forty small 
areas, the averages of data in the individual colors, 

20 i.e., R, G and B, are calculated in each divided area 
and then the data are converted to R/G— B/G coordinate 
data to detect skin color data. In addition, group 
decision-making processing is performed on detected skin 
color data so that the detected skin color data are 

25 ultimately judged to be true skin color data only if at 
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least a specific number of sets of data among the sets 
of data surrounding the detected skin color data also 
indicate skin color. As a result, since the subject in 
a given small area block is likely to indicate a single 
color, an advantage is achieved in that detection of a 
specific color present in each block is facilitated. It 
is to be noted that the group decision-making processing 
may be omitted. 

(4) The average value of the color temperatures of the 
data judged to indicate skin color data in the second 
scene analysis is calculated and the white balance 
adjustment R gain and B gain are determined in 
correspondence to the color temperature average value 
thus calculated. Consequently, optimal white balance 
adjustment for the skin-colored portion in the 
photographic field is achieved. For instance, even when 
photographing a person against a green background, the 
skin color of the person can be reproduced regardless of 
the color of the background. 

(5) Since the image -capturing device for scene analysis 
86 is provided inside the finder device 80, it is 
possible to obtain scene analysis data through image- 
capturing performed by the image-capturing device for 
scene analysis 86, determine the white balance 
adjustment gains and store them within the CPU 21 before 
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the mirror 71 becomes raised through an operation of the 
full press switch 23. This eliminates the necessity for 
ascertaining the white balance adjustment gains during 
the photographing sequence started in step S34 by 
5 operating the full press switch 23, thereby achieving a 
reduction in the length of time required for the 
photographing processing compared to a case in which 
scene analysis data are obtained through image -capturing 
during the photographing sequence. 

10 (6) Since the image -capturing device for scene analysis 
86 is utilized for both the image-capturing operation to 
obtain scene analysis data and the subject brightness 
detection, advantages are achieved in that the mounting 
space can be reduced and in that production costs are 

15 reduced compared to an electronic camera that does not 
employ a dual function image -capturing device. 

While the photographic field is divided into 
sixteen middle-sized areas in the first scene analysis 
and the photographic field is divided into forty small 

20 areas in the second scene analysis in the explanation 
given above, it may be divided into a number of areas 
other than sixteen or forty for either scene analysis. 
In addition, while the explanation is given above on an 
example in which the photographic field is divided into 

25 equal rectangular portions, it does not have to be 
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divided into equal portions or rectangular areas. 
Furthermore, while the entire area over which light is 
received at the image -capturing device for scene 
analysis 86 is divided, only a specific partial area may 
5 be used instead. 

In the explanation above, sixteen sets of RGB data 
corresponding to the sixteen areas resulting from the 
division achieved in the first scene analysis are 
converted to TC— Duv coordinate data, and forty sets of 

10 RGB data corresponding to the forty areas resulting from 
the division achieved in the second scene analysis are 
converted to R/G— B/G coordinate data. If the 
photographic field is not divided into sixteen areas and 
forty areas, the data corresponding to the smaller 

15 number of divided areas should be converted to TC— Duv 

coordinate data and the data corresponding to the larger 
number of divided areas should be converted to R/G— B/G 
coordinate data. Alternatively, the coordinate system 
into which conversion is to be achieved may be selected 

20 in correspondence to specific photographing purposes, 

regardless of the number of divided areas. For instance, 
when photographing a multicolored subject, as in 
landscape photographing, the TC— Duv coordinate system 
may be selected to achieve consistent white balance 

25 adjustment for all the colors, whereas by selecting the 
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R/G— B/G coordinate system when photographing a person as 
in portrait photographing, optimal white balance 
adjustment can be achieved for a specific color such as 
skin color. 

5 While the white balance adjustment gains are 

ascertained by detecting skin color in the second scene 
analysis in the explanation given above, green color or 
an achromatic color, for instance, may be detected 
instead of skin color. In addition, the color to be 

10 detected may be switched in correspondence to the 
photographing mode setting so that skin color is 
detected when photographing a person and green is 
detected when a landscape is photographed. For instance, 
by detecting green when the photographing mode is set to 

15 a distant -view photographing mode and detecting skin 

color when it is set to a portrait photographing mode, 
optimal white balance adjustment is achieved for the 
individual detected colors. Furthermore, a plurality of 
colors such as skin color and green may be detected to 

20 determine white balance adjustment gains by using the 
color indicated by the largest number of sets of data 
having undergone group decision-making processing. 

While the second scene analysis is performed if no 
achromatic color is detected in the first scene analysis, 

25 either the first scene analysis or the second scene 
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analysis may be performed selectively to determine the 
white balance adjustment gains based upon the color 
temperature obtained through the selected scene analysis. 
Alternatively, both scene analyses may be implemented, 
5 and the white balance adjustment gains may be 

ascertained by averaging the two color temperatures 
obtained through the two scene analyses. 

While the explanation is given above on an example 
in which the present invention is adopted in a single 

10 lens reflex digital still camera, the present invention 
may be adopted in digital cameras other than single lens 
reflex digital still cameras. In such a case, the 
subject image is formed separately at the image- 
capturing device for photographing and the image - 

15 capturing device for scene analysis by using a beam 

splitter, a half -mirror or the like. In addition, while 
the image-capturing device for photographing and the 
image-capturing device for scene analysis are provided 
independent of each other in the explanation given above, 

20 the image -capturing device for photographing may also 

function as an image-capturing device for scene analysis. 
In that case, while the power remains ON, the subject 
image captured by the image -capturing device for 
photographing is displayed repeatedly as a through image 

25 at a display such as a liquid crystal monitor regardless 
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of whether the shutter release button has been operated 
or not, and the white balance adjustment gains are 
determined using the data obtained through image- 
capturing performed by the image -capturing device for 
5 photographing. Furthermore, white balance adjustment is 
performed on subject image data that are obtained 
through image -capturing when a shutter release operation 
is performed by using the white balance adjustment gains. 
Moreover, while the TC— Duv coordinate system and 

10 the R/G— B/G coordinate system are used as color-related 
coordinate systems in the explanation above, a 
coordinate system using color difference signals R-Y and 
B-Y may be used, instead. 

— Second Embodiment — 

15 FIG. 12 shows the overall structure of the 

electronic camera in the second embodiment. The same 
reference numbers are assigned to components similar to 
those in FIG. 1 and the explanation will mainly focus on 
the differences. Reference number 186 indicates a color 

20 sensor which is provided at a position conjugate with 

the position of an image-capturing device 73 relative to 
a taking lens 91. The color sensor 186 is an image- 
capturing device similar to the image -capturing device 
for scene analysis 86 in the first embodiment, and 

25 subject light that forms an image at the finder mat 81 
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further travels through the pentaprism 82, the prism 84 
and the image-forming lens 85 to enter the color sensor 
18 6 and form an image of the subject image. 

FIG. 13 is a block diagram showing the circuits 
5 employed in the second embodiment of the digital camera 
according to the present invention. The same reference 
numbers are assigned to components similar to those in 
the circuit diagram of the first embodiment in FIG. 2 
and the explanation will mainly focus on the differences. 

10 Input signals from an AE lock switch 17 to be detailed 

later, which holds the photometering results, an AF lock 
switch 18 to be detailed later which holds the focal 
point detection results and area selection switches 19a 
through 19d which select a focal point detection area 

15 and a photometering area are input to the CPU 21. The 

focal point detection device 36 has a plurality of focal 
point detection areas and detects the focal adjustment 
state in one selected focal point detection area. A 
white balance detection circuit 135 is connected to the 

20 CPU 21. 

— White Balance Detection — 

The white balance detection processing performed by 
the white balance detection circuit 135 in FIG. 13 is 
now explained in detail. The white balance detection 
25 circuit 135 includes the color sensor 186 mentioned 
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above, an A/D conversion circuit 135B that converts an 

analog signal output by the color sensor 186 to a 

digital signal, a CPU 135C that generates white balance 

adjustment, TO G - f - f ic irerrfc-s based upon the digitized signal 
A 

5 and a memory 135D in which the referencing look-up table 

is recorded. The CPU 135C determines white balance 

adjustment gains by detecting the white balance in the 

digital data obtained through image- capturing performed 

by the color sensor 186. In this embodiment, the CPU 

10 . 135C detects skin color based upon color information in 

the digital data and determines white balance adjustment 

.^eee#£-3re-reitt-s , i.e., the R gain and the B gain for white 
A 

balance adjustment, in conformance with the detected 
skin color. It is to be noted that in this 

15 specification, a gain adjustment performed to adjust 

skin color to become a more natural skin color is also 
referred to as white balance adjustment. 

The color sensor 186 is a single two-dimensional 
image -capturing element provided with 480 pixels arrayed 

20 over 24 columns (across) X 20 rows (down), for instance, 
as shown in FIG. 14. At the surface of the color sensor 
186, an RGB color filter 86F that is divided into 480 
blocks over 24 columns (across) X 20 rows (down) in 
correspondence to the 480 pixels is provided. An image 

25 of subject light passing through the color filter is 
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captured with the subject light separated into R color 
signals, G color signals and B color signals. When the 
CPU 135C detects color information, subject light color 
data which correspond to the focal point detection area 
5 selected by the focal point detection device 36, to be 
detailed later, are read out from the color sensor 186. 

Points 186V through 186Z in FIG . 14 indicate the 
positions on the color sensor 186 that correspond to the 
focal point detection areas. For instance, if the 

10 center of the photographic field is set for the focal 
point detection area through the focal point area 
setting which is to be detailed later, the R, G and B 
color data present within the rectangular area 
(indicated as the shaded area in FIG. 14) over 6 pixels 

15 (across) X 4 pixels (down) centered around the central 
point 186W of the color sensor 186 are read out. 

In the color data thus read out, one set of color 
data corresponding to R, G and B colors adjacent to each 
other along the lateral direction are referred to as a 

20 target pixel i, and for each target pixel i read out 

from the rectangular area, the ratio R/G of the R color 
data and the G color data and the ratio B/G of the B 
color data and the G color data are calculated. In the 
rectangular area ranging over 6 pixels (across) X 4 

25 pixels (down), 8 target pixels are present. Data that 



46 




are likely to indicate skin color are detected by 
applying the following relationships (7) and (8) to the 
calculated R/G and B/G. 

5 SRGLOWER < Fi (R/G) < SRGUPPER (7) 
SBGLOWER < Fi (B/G) < SBGUPPER (8) 

In the above relational expressions, SRGLOWER and 
SRGUPPER represent the lower threshold value and the 

10 upper threshold value of the R color ratio in skin color 
dec is ion -making, and SBGLOWER and SBGUPPER represent the 
lower threshold value and the upper threshold value of 
the B color ratio in the skin color decision-making. In 
addition, Fi (R/G) and Fi (B/G) represent the ratio of the 

15 R signal and the G signal and the ratio of the B signal 
and the G signal in a given target pixel i. These 
threshold values are stored in advance at the memory 
135D, and are set so that 0.9 <Fi (R/G) < 1.1 and 0.7 
<Fi (B/G) < 0.9, for instance. 

20 Data that are likely to indicate skin color that 

satisfy the relational expressions (7) and (8) above are 
now referred to as a target pixel j , and the average 
value of the ratios R/G corresponding to all the target 
pixels j and the average value of the ratios B/G 

25 corresponding to all the target pixels j are calculated 
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through the following formulae (9) and (10) . 




(9) 



J m 

-J,Fj(B/G) 
m pi 



(10) 



5 

with, Fj (R/G) representing the ratio of the R signal and 
the G signal in a target pixel j , 

Fj (B/G) representing the ratio of the B signal and the G 
signal in the target pixel j , and 

10 m representing the number of target pixels j that 
satisfy the relational expressions (7) and (8). 

A correlated color temperature is determined based 
upon the average values of the ratios R/G and the ratios 
B/G thus calculated. FIG. 15 presents correlated color 

15 temperature curves, with the horizontal axis 

representing R/G and the vertical axis representing B/G. 
By dividing the R signal and the B signal with the G 
signal, the red color component and the blue color 
component in the color of the subject can be expressed, 

20 free of any influence of the subject brightness 

difference. As the color temperature rises, the blue 
color component becomes more intense, whereas as it 
decreases, the red color component becomes more intense. 
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Since the correlated color temperature curves in FIG. 15 
are stored in advance at the memory 13 5D as a look-up 
table, the correlated color temperature is read out from 
the memory 135D in correspondence to the results 
5 obtained through the calculation performed by using 
formulae (9) and (10) above. In conformance with the 
correlated color temperature thus read out, the white 
balance adjustment R gain for the R data and the white 
balance adjustment B gain for the B data are ascertained 

10 using FIG. 7 explained earlier. 

As described above, FIG. 7 illustrates the 
relationships between the correlated color temperature 
and the R and B gains. The R gain and the B gain values 
are determined in advance by using data obtained through 

15 actual measurement so as to adjust data detected to 
represent skin color to achieve a more natural skin 
color and are expressed as functions of the color 
temperature. These R gain and B gain values are stored 
in advance at the memory 13 9D as a look-up table and are 

20 read out from the memory 135D in correspondence to the 
ascertained correlated color temperature, as explained 
above . The R gain and B gain values, thus read out are 
set as white balance adjustment eee^#i€-3re-ntrs- to be used 
for white balance adjustment. The white balance 

25 adjustment gains are stored in the memory 13 5D and are 
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also sent to the image processing CPU 29 via the CPU 21. 



The white balance adjustment / ^e^ef*i-e4^i^&- 
determined as described above are used during white 
balance adjustment that is performed by a gain 
5 adjustment circuit 103 on image data subsequently 

obtained through image -capturing by the CCD 26. The 
white balance adjustment is achieved by applying the 
white balance adjustment R gain and B gain respectively 
to the R signal and the B signal over the entire area 
10 obtained through the image -capturing operation performed 
by the CCD 26, regardless of which area has been used 
for white balance detection. 



15 point detection device 36 and the principle of the focal 
point detection operation performed by the focal point 
detection device 3 6 are explained. The focal point 
detection device 36, which is controlled by the CPU 21, 
is constituted of an infrared light blocking filter 700, 

20 a visual field mask 900, a field lens 300, an aperture 
mask 400, image re-forming lenses 501 and 502, an image 
sensor 310 and the like. An area 800 represents the 
exit pupil of the taking lens 91 (see FIG. 12) . In 
addition, areas 801 and 802 are areas where images 

25 obtained by reverse projecting opening portions 401 and 




— Focal Point Detection — 



In reference to FIG. 16, the structure of the focal 
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402 formed at the aperture mask 400 onto the area 800 by- 
using the field lens 300 are present. It is to be noted 
that the infrared light blocking filter 700 may be 
positioned either to the right or to the left of the 
5 visual field mask 900. A light flux that has entered 

via the areas 801 and 802 becomes focused on a plane 600 
which is equivalent to the surface of the CCD 26, and 
then travels through the infrared light blocking filter 
700, the visual field mask 900, the field lens 300, the 

10 opening portions 401 and 402 and the image re-forming 
lenses 501 and 502 to form an image on image sensor 
arrays 310a and 310b. 

The pair of subject images formed on the image 
sensor arrays 310a and 310b are positioned close to each 

15 other in a so-called front focus state in which the 
taking lens 91 forms a clearly defined image of the 
subject at a position preceding (toward the subject) at 
a CCD 26 -equivalent plane 600, whereas they are 
positioned further away from each other in a so-called 

20 rear focus state in which a clearly defined image of the 
subject is formed at the position rearward relative to 
CCD 26 -equivalent plane 600. When the subject images 
formed on the image sensor arrays 310a and 310b achieve 
a specific distance from each other, the clearly defined 

25 image of the subject is set on the CCD 26 -equivalent 
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plane 600. Thus, by converting this pair of subject 
images through electrical signals to photoelectric 
conversion performed at the image sensor arrays 310a and 
310b and ascertaining the relative distance between the 
5 pair of subject images through arithmetic processing 

performed on the signals, the focal adjustment state of 
the taking lens 91, i.e., the distance over which and 
the direction in which the position at which the clearly 
defined image formed by the interchangeable lens 90 is 

10 offset from the CCD 26 -equivalent plane 600 that are 

indicated as an offset quantity are determined. In FIG. 
16, the focal point detection area is equivalent to the 
area over which the image sensor arrays 310a and 310b, 
which are reverse projected by the image re-forming 

15 lenses 501 and 502 overlap each other in the vicinity of 
the CCD 26-equivalent plane 600. 

The focal point detection area is set within the 
photographic image plane in the following manner. FIG. 
17 illustrates the area selection switches 19a through 

20 19d provided at the rear of the digital still camera. 
FIG. 18 shows a screen observed through the eyepiece 
lens 83. The 5 marks 9V through 9Z in FIG. 18 indicate 
focal point detection areas. A new focal point 
detection area is selected by operating one of the area 

25 selection switches 19a through 19d before a specific 
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length of time elapses after an operation of the halfway 
press switch 22. 

When the halfway press switch 22 is operated, the 
area selection switches 19a through 19d become effective 
5 over a specific length of time. If the switch 19a is 
operated during this period of time, the focal point 
detection area setting is changed to the focal point 
detection area 9V positioned above the currently 
selected focal point detection area 9W in FIG. 18. If 

10 the area selection switch 19b is operated, the focal 
point detection area setting is changed to the focal 
point detection area 9W again. If the area selection 
switch 19c is operated, the focal point detection area 
setting is changed to the focal point detection area 9Y 

15 to the left of the focal point detection area 9W. 

Likewise, by operating the area selection switch 19d, 
the focal point detection area setting is changed to the 
focal point detection area 9Z positioned to the right of 
the currently selected focal point detection area 9W. 

20 The selected focal point detection area is highlighted 
compared to the markers of the other areas, as is the 
area 9Y in FIG. 18, for instance. When the photographer 
selects one of the marks 9V through 9Z located on the 
main subject, the focal adjustment state in the focal 

25 point detection area within the photographic image plane 
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corresponding to the selected mark is detected as 
described earlier . 

It is to be noted that FIG. 16 shows only one focal 
point detection area to facilitate explanation of the 
5 principle of the focal point detection. When there are 
a plurality of focal point detection areas within the 
photographic field as shown in FIG. 18, a plurality of 
openings, the number of which corresponds to the number 
of focal point detection areas, are formed at the visual 

10 field mask 900. In addition, an optical system is 

provided so that a light flux having passed through the 
plurality of openings at the visual field mask 900 form 
a pair of subject images per opening. 

During the focal point detection operation 

15 performed by the focal point detection device 36, when 
the AF lock switch 18 is turned ON, the taking lens 91 
is moved to the focus position by the lens drive circuit 
3 7 in conformance to the currently detected focal 
adjustment state, and the subsequent focal point 

20 detection operation is suspended until the photographing 
processing is completed. The information with regard to 
the focal point detection area used in the focal point 
detection operation is also used to determine the area 
to undergo white balance detection as explained earlier. 

25 Namely, points 186V through 186Z on the color sensor 186 
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respectively correspond to the focal point detection 
areas 9V through 9Z. For instance, if the area 9Y in 
FIG. 18 is selected as the focal point detection area, 
the G, B and R color data present within the rectangular 
5 area ranging over 6 pixels (across) X 4 pixels (down) 

centered on the point 186Y in FIG. 14 are read out from 
the color sensor 186 during the white balance detection 
explained earlier. The focal point detection area 
information and the operating state of the AF lock 

10 switch 18 are also sent to the white balance detection 
circuit 135 from the CPU 21. 

FIG. 19 is a flowchart of the white balance 
detection processing achieved in the embodiment. In 
step S201, a decision is made as to whether or not the 

15 AF lock switch 18 has been turned ON. If a negative 

position is made (step S201; N) , the operation proceeds 
to step S202, whereas if an affirmative decision is made 
(step S201; Y) , the operation proceeds to step S210. In 
step S202, signal charges are stored at the color sensor 

20 186 and signals corresponding to the stored charges are 
converted to digital data at the A/D conversion circuit 
135B. In step S203, positional information indicating 
the focal point detection area over which a focal point 
detection operation is to be performed by the focal 

25 point detection device 3 6 is read out from the memory 
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135D. In step S204, the ratio of the R color data and G 
color data and the ratio of the B color data and the G 
color data in the R, G and B color pixel data within the 
specific area centered on the position corresponding to 
5 the focal point detection area on the color sensor 186 
are calculated. 

In step S205, a decision is made as to whether or 
not there are any data likely to indicate skin color 
among the target pixels i by using relational 

10 expressions (7) and (8) . If at least one target pixel j 
satisfying both of the relational expressions is 
detected, an affirmative decision is made (step S205; Y) , 
and in that case the operation proceeds to step S206. 
In step S2 06, the average values of m sets each of 

15 ratios R/G and B/G detected by using relational 

expressions (7) and (8) are calculated by using formulae 
(9) and (10) . 

In step S207, the correlated color temperature 
corresponding to the average values of the ratios R/G 

20 and B/G thus calculated is read out from the memory 13 5D. 
In step S208, the white balance adjustment R gain for 
the R data and the white balance adjustment B gain for 
the B data are ascertained based upon the relationships 
between the correlated color temperature and the white 

25 balance adjustment gains shown in FIG. 7. The R gain 
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and the B gain thus determined are stored in the memory 
135D. In step S209, the white balance adjustment R gain 
and B gain are provided to the image processing CPU 29, 
and thus, the processing in FIG. 19 ends. 
5 If a negative decision is made (step S205; N) in 

step S205, the operation proceeds to step S211, in which 
specific white balance adjustment R gain and B gain 
stored in the memory 13 5D are read out. These R gain 
and B gain values are stored in advance in the memory 

10 135D as default values. 

If an affirmative decision is made in step S201, 
the operation proceeds to step S210 to read out the R 
gain and the B gain stored in step S208 during the 
previous operation from the memory 135D. In other words, 

15 if the AF lock switch 18 is in an ON state, another 

arithmetic operation to ascertain white balance 

adjustment ^ oc - f f i c i ent s- is not performed. When the AF 
A- 

lock switch 18 is turned ON, the white balance 
adjustment ^o of f icicnto are determined based upon data 

20 indicating a color likely to be skin color that are 

detected at that point in time and the subsequent white 
balance detection operation is suspended until the 
photographing operation is completed. The operating 
state of the AF lock switch 18 is also provided to the 

25 white balance detection circuit 135 from the CPU 21. 
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The operation of the digital still camera 
structured as described above is now explained. FIG. 2 0 
is a flowchart of the photographing processing. In step 
S301, a decision is made as to whether or not the AF 
5 lock switch 18 is set in an ON state. If a negative 

decision is made (step S301; N) , the operation proceeds 
to step S302, whereas if an affirmative position is made 
(step S301; Y) , the operation proceeds to step S303. In 
step S302, the focal point detection device 36 detects 

10 the focal adjustment state, and based upon the focal 

adjustment state thus detected, the lens drive device 37 
drives the taking lens 91 to the focus position. In 
step S303, the white balance detection processing 
explained in reference to FIG. 19 is performed. 

15 In step S304, the individual pixels at the CCD 26 

store light- receiving signals, and when the storage is 
completed, the stored charges in all the pixels are 
sequentially read out. The image data thus read out 
undergo the processing at the analog signal processing 

20 circuit 27, are converted to digital image data at the 
A/D conversion circuit 2 8 and are data to the image 
processing CPU 29. The image processing CPU 29 performs 
specific types of image processing including the white 
balance adjustment explained earlier, and in step S305, 

25 a through image resulting from the image processing is 
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displayed at the monitor 32. 

In step S306, a decision is made as to whether or 
not the halfway press switch 22 has been operated, and 
if an affirmative decision is made (step S306; Y) , the 
5 operation proceeds to step S307, whereas if a negative 
decision is made (step S306; N) , the operation returns 
to step S301. In step S307, a photometering operation 
to detect the brightness level of the subject is 
performed. The subject brightness detection is 

10 performed by the CPU 135C by using the data output from 
the color sensor 186. When the CPU 135C outputs the 
brightness data obtained through the detection to the 
CPU 21, the CPU 21 performs exposure calculation based 
upon the brightness data. In step S308, a decision is 

15 made as to whether or not the AF lock switch 18 has been 
turned ON. If a negative decision is made (step S308; 
N) , the operation proceeds to step S309, whereas if an 
affirmative decision is made (step S308; Y) , the 
operation proceeds to step S310. 

20 In step S309, the focal point detection device 36 

detects the focal adjustment state, and based upon the 
detected focal adjustment state, the lens drive device 
37 drives the taking lens 91 to the focus position. If 
it is decided in step S310 that the full press switch 23 

25 has been operated (step S310; Y) , the quick-return 
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mirror swings upward and the photographing sequence 
starting in step S3 11 begins. If, on the other hand, a 
negative decision is made (step S310; N) , the operation 
proceeds to step S3 17 to perform timeout decision-making. 
5 If it is decided in step S317 that there is no timeout 
(step S317; N) , the operation returns to step S310, 
whereas if it is decided in step S317 that time is up 
(step S317; Y) , the processing in FIG. 20 ends without 
performing a photographing sequence. 

10 In step S3 11, the individual pixels at the CCD 26 

store light- receiving signals and when the storage is 
completed, the stored charges in all pixels are 
sequentially read out. In step S312, the image data 
that have been read out undergo the processing at the 

15 analog signal processing circuit 27, are converted to 

digital image data at the A/D conversion circuit 28 and 
are input to the image processing CPU 29. Then, the 
operation proceeds to step S3 13, in which the white 
balance adjustment explained earlier, the gamma 

20 gradation control, JPEG formatting processing and the 

like are performed at the image processing CPU 29. When 
the image processing is completed, the operation 
proceeds to step S3 14 to temporarily store the image 
data resulting from the image processing in the buffer 

25 memory 3 0 and also to display a freeze frame image at 
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the monitor 32. In step S315, the image data read from 
the buffer memory 3 0 are compressed at the JPEG 
compression circuit 33. In step S316, the compressed 
image data are stored in the memory card 34 before 
5 ending the processing in FIG. 20. 

While the explanation is given above on the 
assumption that photographing is performed under natural 
light, it is necessary to adjust the white balance 
adjustment gains if a photographing operation is 

10 performed under fluorescent light. Generally speaking, 
the color temperatures of the RGB data obtained through 
a photographing operation performed under fluorescent 
light are higher than color temperatures resulting from 
a photographing operation performed under natural light. 

15 This difference in the color temperatures can be 

compensated for by correcting the R gain and the B gain 
values in FIG. 7 by specific quantities. Thus, two 
look-up tables storing R gain and B gain values should 
be provided, one for photographing under natural light 

20 and the other for photographing under fluorescent light 
so that values can be read out from the look-up table 
corresponding to the photographing light set by the 
photographer in advance . 

The following advantages are achieved in the 

25 digital camera in the second embodiment. 
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(1) Target pixels j, with data indicating a color 
likely to be skin color are detected in the output from 
the color sensor 186, the averages of the ratios R/G and 
B/G in the target pixels j thus detected are ascertained 
5 and the average values are converted to data in the R/G— 
B/G coordinate system to obtain the corresponding 
correlated color temperature. In addition, the white 
balance adjustment R gain and B gain are determined in 
yy correspondence to the correlated color temperature thus 

D 10 ascertained so that optimal white balance adjustment is 

*y performed on skin color data. Consequently, when 

SJ performing a portrait photographing operation, a white 

Q balance adjustment that is optimal for the skin color of 

M= the person is achieved regardless of the color of the 

Q 15 background. 

~~ (2) The detection of target pixels j with data 

indicating a color likely to be skin color in (1) above 
is performed by using color data read out from the color 
sensor 186 in correspondence to the focal point 
20 detection area selected by the focal point detection 

device 36. In other words, if the focal point detection 
area 9Y in FIG. 18 is selected, target pixels j are 
detected by using the R, G and B color data present 
within the rectangular area ranging over 6 pixels 
25 (across) X 4 pixels (down) centered on the point 186Y in 
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FIG. 14. Since the focal point detection area is 
normally set at the position at which the main subject 
is present, by using the color data from the color 
sensor 186 corresponding to this area, an advantage is 
5 achieved in that the detection of data indicating a 
color likely to be skin color is facilitated for 
portrait photographing. 
_ (3) When the AF lock switch 18 is turned ON, the white 

/^O balance adjustment ^e^ eiri c i ci i-La- are determined based 

Lff J 

O 10 upon the data indicating a color likely to be skin color 

UJ 

that are detected at that point in time, and the 
SI subsequent white balance detection operation is 

O suspended until the photographing processing is 

M completed. For instance, by turning ON the AF lock 

p 15 switch 18 with the main subject positioned in the 

selected focal point detection area and then panning the 
camera before performing the photographing operation, 
fir the optimal white balance adj ustment^- ^ef f ie -i-ejat-s and 

the optimal focus state for the main subject can be 
20 sustained even when photographing with the main subject 
set outside the focal point detection area. 
(4) Since the color sensor 186, is provided within the 
finder device 80, the white balance adjustment gains can 
be determined and provided to the image processing CPU 
25 2 9 in advance by receiving data for white balance 
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detection at the color sensor 186 before the mirror 71 
is raised through an operation of the full press switch 
23. Thus, since the need for determining the white 
balance adjustment gains during the photographing 
5 sequence started in step S311, by the operation of the 
full press switch 23 is eliminated, the length of time 
required for the photographing processing is reduced 
compared to the processing time required for a 
photographing sequence during which data for white 

10 balance detection are received. 

(5) Since the color sensor 186 is utilized for both 
white balance detection and subject brightness detection, 
the mounting space can be reduced and the production 
cost can be reduced compared to a camera having separate 

15 devices for white balance detection and subject 
brightness detection . 

While the explanation above is given on a single 
lens reflex digital still camera, the present invention 
may be adopted in digital cameras other than single lens 

20 reflex digital still cameras. In such a case, separate 
subject images are formed at the CCD 2 6 and the color 
sensor 186 by employing a beam splitter, a half mirror 
or the like. 

In addition, while the CCD 26 and the color sensor 
25 186 are provided independently of each other in the 
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explanation given above, the CCD 26 may also function as 
a color sensor. In such a case, the white balance 
adjustment gains are determined as described above by 
using data obtained through image -capturing performed by 
5 the CCD 26. Then, white balance adjustment is performed 
using the white balance adjustment gains on the subject 
image data obtained through image -capturing performed in 
response to a shutter release operation. 

While the CCD 26 and the image sensor 310 of the 

10 focal point detection device 36 are provided 

independently of each other in the explanation given 
above, the functions of the image sensor 310 may be 
achieved through CCD 26 instead. In addition, while the 
image sensor 310 and the color sensor 186 are provided 

15 independently of each other, the functions of the color 
sensor 186 may be achieved through the image sensor 310 
instead. Furthermore, the CCD 26 may also function as 
both the image sensor 310 and the color sensor 186. 

In the explanation given above, when the CPU 135C 

20 detects color information, the color data are read out 
from the rectangular area of the color sensor 186, 
ranging over 6 pixels (across) X 4 pixels (down) 
centered on the position corresponding to the focal 
point detection area, and the ratio of the R color data 

25 and the G color data and the ratio of the B color data 
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and the G color data in the R, G and B color data thus 
read out are calculated. However, R/G and B/G may be 
calculated by reading out a set of R, G and B data in 
the vicinity of the position on the color sensor 186 
5 corresponding to the focal point detection area instead 
of using the color data within the rectangular area 
described above. 

In the explanation above, target pixels j with data 
indicating a color likely to be skin color are detected 

10 in correspondence to the focal point detection area 
selected by the focal point detection device 36. 
However, if the digital camera has a plurality of 
photometering areas within the photographic field and a 
spot photometering operation is performed in one of the 

15 photometering areas that is selected, target pixels j 

with data indicating a color likely to be skin color may 
be detected in correspondence to the selected 
photometering area instead. In the embodiment, the 
subject brightness is detected based upon the level of 

2 0 the value of the color data output by the color sensor 

186 and the exposure calculation is performed based upon 
the detected brightness value. Thus, the brightness 
detection and the white balance detection may both be 
performed by using the color data read from the color 

25 sensor 186 in correspondence to the selected 
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photometering area. Since the spot photometering area 
is set at the main subject under normal circumstances, 
an advantage is achieved in that by using the color data 
read out from the color sensor 186 in correspondence to 
the selected spot photometering area, the detection of 
data indicating a color likely to be skin color is 
facilitated in portrait photographing. 

In addition, in step S201 in the flowchart 
presented in FIG. 19, a decision is made as to whether 
or not the AF lock switch 18 has been turned ON, and if 
it is decided that the AF lock switch 18 has been turned 
ON, the operation proceeds to step S210 to suspend the 
subsequent white balance detection operation until the 
photographing processing is completed. Alternatively, a 
decision may be made in step S201 as to whether or not 
the AE lock switch 17 instead of the AF lock switch 18 
has been turned ON. In this case, when the AE lock 
switch 17 is turned ON, the white balance adjustment 
x; o o f f i c i - cn L t=r are determined based upon the data 



indicating a color likely to be skin color that are 
detected at that point in time and the subsequent white 
balance detection operation is suspended until the 
photographing processing is completed. For instance, by 
turning ON the AE lock switch 17 with the main subject 
positioned at the center of the photographic field and 
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then panning the camera before performing the 
photographing operation, the optimal white balance 
ad j us t men t^-eC c f f i c -rerrtrs- and the optimal exposure value 
that have been calculated for the main subject are 
maintained even when photographing with the main subject 
offset from the center of the photographic field. The 
photometering area information and the operating state 
of the AE lock switch 17 are also provided to the white 
balance detection circuit 135 from the CPU 21. 

Moreover, step S201 in FIG. 19 may be omitted. In 
such a case, the white balance detection operation in 
step S202 and in the subsequent steps is performed, 
regardless of operating state of the AF lock switch 18. 
In addition, steps S301 and S308 in the flowchart in FIG. 
20 may be omitted. In this case, a focal point 
detection operation is performed by the focal point 
detection device 36 in step S302 and step S309. 
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